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Abstract. We give a new proof of the theorems on the maximum entropy principle in 
Tsallis statistics. That is, we show that the (/-canonical distribution attains the maximum value 
of the Tsallis entropy, subject to the constraint on the (/-expectation value and the (/-Gaussian 
distribution attains the maximum value of the Tsallis entropy, subject to the constraint on the 
q- variance, as applications of the nonnegativity of the Tsallis relative entropy, without using the 
Lagrange multipliers method. In addition, we define a (/-Fisher information and then prove a 
(/-Cramer-Rao inequality that the (/-Gaussian distribution with special (/-variances attains the 
minimum value of the (/-Fisher information. 
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1 Introduction 

The problems on maximum entropy principle in Tsallis statistics [U [2] has been studied in 
classical system and quantum system [31 HI [6]. Such problems have been solved by the use 
of the Lagrange multipliers formalism. However we give a new proof for such problems, that is, 
we prove them by applying the Tsallis relative entropy without Lagrange multipliers formalism. 
Moreover, we derive a one-parameter extended Cramer-Rao inequality involving a one-parameter 
extended Fisher information. 

We denote the (/-logarithmic function ln g by 

x l -i — i 

\n q x = (gGl,g/l,x>0) 

1-q 

and the (/-exponential function exp„ by 

ex Pg (x)^( (l + (l-g)*)^, if l + (l-?)z>0, ( q eR,q^l,xeR). 
I otherwise 

The functions exp Jx) and ln q x converge to exp(a;) and logx as q — t 1, respectively. Note that 
we have the following relations: 

exp {x + y + (1 - q)xy} = exp Jx) exp Jy), ln q xy = ln q x + ln 9 y + (1 - q) \u q x \u q y. (1) 
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In the following of this section, we define the Tsallis entropy and the Tsallis relative en- 
tropy for the probability density functions. The set of all probability density function on R is 
represented by 

D= j/ f(x) > 0, J f(x)dx = Vj. 

Then the Tsallis entropy [1] is defined by 



H q (cf>(x)) = - ^{xfh^^dx (2) 

J — oo 

for any nonnegative real number q ^ 1 and a probability density function 4>{x) G D. In addition, 
the Tsallis relative entropy is defined by 

/oo 
0(x) 9 (ln 3 ^(x)-ln^(x))c/x (3) 
-oo 

for any nonnegative real number g / 1 and two probability density functions <p{x) E D and 
ip{x) G D. Taking the limit q — > 1, the Tsallis entropy and the Tsallis relative entropy converge 
to the Shannon entropy Hi((f)(x)) = — J*^^ 4>(x) log 4>(x)dx and the Kullback-Leibler divergence 
Di((j)(x)\^(x)) = J^° oo (j)(x)(log(l)(x) — log^(x))dx, respectively. See [7j for fundamental proper- 
ties on the Tsallis relative entropy. 

We define two sets involving the constraints on the normalized (/-expectation value and q- 
variance: 

Cf = If G D : - r xf{xYdx = fi q \ 

I c q J -oo ) 



and 



= \f G Cf : - f°° (x - ^ffixfdx = a 2 V 



where c q = f(x) q dx is a normalization factor. 

Then the g-cannonical distribution <jy q (x) G D and the q-Gaussian distribution (jr q (x) G D 
were formulated in P H H El Ej by 

^ q c \x) = ^exp q {-p( c \x-n q )}, Zf= r exp q {-/3^(x-^ q )} 

Zq J — oo 

and 

<Pa>(. x ) = 7777 ex P« { 73. > > Z a ' = / ex Po { 73. > > 



respectively, where (3 q c ^ and are constant numbers depending on the parameter q, and we 
often use ^ = g^-. 

2 Tsallis maximum entropy principle 

In this section, we revisit the maximum entropy principle in nonextensive statistical physics. 
The maximum entropy principles in Tsallis statistics have been studied and modified in many 
literatures [3j [H \5\ [8] . Here we prove two theorems that maximize the Tsallis entropy under 
two different constraints by the use of the nonnegativity of the Tsallis relative entropy instead 
of the use of the Lagrange multipliers method. 
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Lemma 2.1 For q / 1, we have 

D q ^{x)\^{x)) > 0, 
with equality if and only if 4>{x) = ip(x) for all x. 

Proof. Since we have lrig x < x — 1 with equality if and only if x = 1 for any g 6 R, g / 1, we 
have 



y " 0(x)ln 9 ||||dx y * 0(s) ( ----- - : I d.r - 0. 



</>(x) 



with equality if and only if (f)(x) = ip(x) for all x. 



Theorem 2.2 If (f> G C { q c) , then 



H q ((f)(x)) < -c g ln g 



with equality if and only if 

^ = ~(cj eXP <? {-fflfr ~ Vq)} , 
Z q 

where (3^ is a constant number depending on the parameter q, Z^f 1 = exp g j— (3 q c \x — dx 
and c q = (f){x) q dx. 

Proof Putting 

</> (x) = exp g (-/3j c ) (x - //,)) , = f°° ex Pq (-^ (x - ^)) dx 

Zq J — oo 

and taking an account for ln ? | = ln g y + y 1-9 ln g ^ and ln g ^ = — x 9-1 ln g x, we have 
J (f)(x) q lnqip(x)dx = J (t)(x) q ln q j— exp ? (-/^ c) (x - | dx 
= f% (x) 9 | -$ c > (x - ^ ) + ex P(? (x - fx q )) ^ In, 1 dx 

J -oo Zq J 

/OO 1 /-OO - - 

(x-^)0(x)^x + l n(? — / 0(x) 9 {l-/3( c )(l-g)(x-^)}dx 



Cqln q 

£q 



Thus we have 

/OO /"OO ^ 

^ (x) 9 ln 9 4>(x) dx < — (f> (x) q ln g V 0*0 dx = — c g ln g — -p- 
-oo J —oo Zq 

by the nonnegativity of the Tsallis relative entropy. From the equality condition of the Tsallis 
relative entropy, we see that the maximum attains if and only if 



<j> (x) = ip (x) = exp g (-/3j c) (x - Hqf) . 
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Remark 2.3 The generalized free energy takes minimum: 

1 c 1 

F q = (^)Hq((j)(x)) >^q + -h ln > 



if and only if (ft (x) = exp ? y—fiq^ (x — due to Theorem \2.2[ 

Corollary 2.4 If <ft £ c[ , then Hi(4>(x)) < \ogZ^ with equality if and only if <p(x) = 
-^expj-^x -//)}. 

Proof. Take the limit q — > 1 in Theorem 12.21 ■ 
By the condition on the existence of q- variance a q (i.e., the convergence condition of the 
integral f x 2 exp (? (— x 2 )dx), we consider g£l such that < q < 3 and q / 1. 

Theorem 2.5 For g_ € M such that < q < 3 and q / 1 if 4> € Cq 9 \ then 

H q {<P(x)) < -c q \n q -L + c q (3^Z^ q -\ 

Z q 

with equality if and only if 



where Z { q g) = ex Pf , {-#(x - /i g ) 2 /^ 2 } dx with # = 1/(3 - q). 
Proof. Putting 



^ex P ( Wb-i*) 2 } Z ( 9)= r exp I A 9) j X -^f 
Vq \ °i y 9 "/-co P9 v 



and taking account for ln 9 ^ = In, y + y 1 q ln g ^ and ln g ^ = —x q 1 ln g x, we have 

dx 



4> {xf \n q V> (x) dx = l°° ct> (x) q 1% j ex Pf/ (~ ^-^| ~ 

' - M?) W ^ + ln 9 — 77T / <P ( X ) { 1 2 



dx 



-P^c q + c 9 In, -L - /3js) Cg (1 - ? ) In, 

-^ClZ^-'+Cqlnq-L. 

Zn 



Thus we have 



H g ((j>(x)) = - I 4> {xf \u q <f> (x) dx < - j 4> {xf ln 9 4> (x) dx = c q (3^Z^ q ~ - c q ln q — {g) 
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by the nonnegativity of the Tsallis relative entropy. From the equality condition of the Tsallis 
relative entropy, we see that the maximum attains if and only if 



4 9) q \ 



Corollary 2.6 If 4> £ C[ 9 \ then H\{(f){x)) < log \j2irea with equality if and only if <p(x) 
1 exp{-<^}. 



Proof. Take the limit q — > 1 in Theorem 12.51 ■ 

3 Minimization of g-Fisher information 

The theorem in the previous section and the fact that the Gaussian distribution minimizes the 
Fisher information lead us to study the Tsallis distribution ((/-Gaussian distribution) minimizes 
a g-Fisher information as a one-parameter extension. We prepare some definitions for this 
purpose. In what follows, we abbreviate /3„ and Z q instead of /3 q 9 ^ and zjf \ respectively. 

Definition 3.1 For the random variable X with the probability density function f{x), we define 
the q-score function s q (x) and q-Fisher information J q (X) by 

, . dln a f(x) 
s q (x) = — ^U, (4) 

J q {X) = E q [s q (xf] , (5) 

where a normalized q-expectation value E q is defined by E q [g(X)] = - y^^^~~ f or random 
variables g(X) for any continuous function g{x) and the probanility density function f(x). 

Note that our definition of a g-Fisher information is different from those in several literature 

[naim iia nana sang. 



Example 3.2 For the random variable G obeying to q-Gaussian distribution 



^(x) = ^-exp, j- 



Pq ( x ~ Vqf 



where f3 q = and q-partition function Z q = exp 9 | — Om^L^s! j dx, the q-score function 
is calculated as 



Sg(x) = [x _ . 



Thus we can calculate the q-Fisher information as 



Jq (G) = Pq j ■ (6) 



t, 



Note that we have 

lim J q {G) = \. (7) 
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Theorem 3.3 Given the random variable X with the probability density function p(x), the q- 



expectation value (j, q = E q [X] and the q-variance o~ q = E q (X — fi q ) 2 
inequality: 

' / 1 A for ge[0,l)u(l,3). 



Immediately we have 



J q (X)>^ for <7 6(1,3). 



a 



, we have a q-Cramer-Rao 

(8) 

(9) 



Proof. Here W6 assume tlicit lini a -_^.-j- GO f(x)p(x) = for any q > 0, any probability density 
function p(x) and any smooth function / which is suitably well-behaved at ±oo. Then we have 



E q [(X - fi q ) s q (x)} 



f (X - H q )p{xfSq{x)dx 

f p(x) q dx 

J (x - H q )p'(x)dx 

J p(x) q dx 

-1 



f p(x) q dx 



Thus we have 



< E a 



E 

J q (X) + \E q [(X - N ) s q (x)] + — 

°~q 

2 1 

9 ^ ^ a q J p(x) q dx (Xg ' 



(x - » q y 



which implies a g-Cramer-Rao lower bound given in ([8]). ■ 

Proposition 3.4 The equality in the q-Cramer-Rao inequality |2jj holds if the probability density 
function p(x) is the q- Gaussian density function 4> q 9 \x) with the q-variance 



q g+1 

2i-9 (3 - g)2(s-i) (1 



B 



1 _J_ 

2' 1-g 



-, (0 <<?<!) 



or 



21-. (g-l)j 
cr 9 = -r- — ^ , (1 < </ < 3) . 

/ 1 J_ 

D \q-l 2> 2 

Proof. We show that the following inequality holds for < q < 3 and g 7^ 1 



(10) 



(11) 



J 9 (G) > \ ( 

a 9 V/^W^ 



(12) 



with equality if the g- variance is given by (|10p or pip . 
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(i) For the case of < q < 1, we firstly calculate 



Zq= I exp g j jdx = J exp ? j — ^- } </// 

1-9 



1 1 - o y i'i-i 



and 



-*(£)Y^*--fK£)**G^)- 

Then the L.H.S. and the R.H.S. of f)12f) are calculated as 

2g-2 



2 2 %f " 2 (3 - g)-^ (1 - q) 1 -* B Q, T l-) ' 



and 



2«+ 1 ^- 1 (3 - (1 - g)-5- B ( — ) - 1, 



respectively. Then we have the inequality 
L.H.S. - R.H.S. 



= 2 2 %f" 2 (3 - q)^ (1 - qf-* B Q, ^ 

1 (3 - q)-— (l-q)—B j + 1 

J 2 %^ i (3- ( ?r 2 * i (i-g)V jB Q i V 1 _ i| >o, 



with equality if Eq. ffTOj) holds, 
(ii) For the case of 1 < q < 3, we similarly calculate 



">-"»^,_iy ~\q-l 2'2 
and 

Then the L.H.S. and the R.H.S. of (|12p are calculated as 

2q-2 



4^- 2 (3 - q)^ (q - l) 1 ^ B (-L-. - I, 0" 
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i 9-3 1-9 / 1 II 

<(8-,)T(,-l)TB — T -j. j 



and 

respectively. Then we have the inequality 
L.H.S. -R.H.S. 

= 4a„ 2g - 2 (3 - q) q ~ 3 (q - I) 1 " 9 B 



1 1 1 



g- 1 2' 2 



2<?-2 



i 9-3 1-9/1 1 1\' 1 

-4^(3-,)-(,-l)-£ — +1 



2af 1 (3 - g) 2 ^ (g - 1) V 5 - |, | ) - 1 \ > 0. 



with equality if Eq, (fTT]) holds. 

■ 

Note that we have Ji(-X") > \ in the limit g — >• 1. Proposition 13. 4l also shows that g-Gaussian 

with q- variance such that Eq. tjlOp or Eq. ljlip minimizes the g-Fisher information. In addition, 
we note on the limit q — > 1 for the q- variances a q given in Eq. (|10p and Eq. (jlip . The following 
results were checked by the computer software: 

9 , s 9+1 1 l_ r r -2 1 

21-9 (3 - g) 2 (-J-i) (1 - 0)2 2— (2 + r)^r2 1 

hm (7„ = lim -. r = lim — 



and 



9 4i-o^ ^1-0 b(i,X) B {hl) 



21-9 ( 3 - g )2( 3 g - 9 i) (g-l)s 
lim o~„ = lim 



9^1+0 q g^l+0 R / _l iJ_ 

D \q-l 2' 2 

Remark 3.5 In our previous paper [11], we gave the rough meaning of the parameter q from 
the information-theoretical viewpoint. In fTW, we showed that the Tsallis entropies for q > 1 had 
the subadditivity and therefore we had several information-theoretical properties in the case of 
q > 1. However, the Tsallis entropies for q < 1 did not have such properties. As similar as the 
case of the Tsallis entropies, in the present paper we have found that q-Fisher information have 
the quite same situation such that we have J q (X) > \ for q > 1, however for the case of q < 1, 

a q 

we do not have any relation between Jg(X) and -\ other than the inequality $8$). Therefore 
these results give us the difference of the q-Fisher information J q (X) for q £ [0, 1) and J q {X) 
for q G (1,3), as similar as the Tsallis entropies did in J7?j/. Summarizing these results, we may 
conclude that the Tsallis entropies and q-Fisher information make a sense for the case of q > 1 
in our setting. 



4 Concluding remarks 

Throughout the present paper, we adopted the normalized g-expectation value as a one-parameter 
generalization of the standard expectation value. In this section, we consider on our results ob- 
tained in Section [2] and [31 for different expectation values. The normalized (/-expectation value 
-E^I-X"] = ^f X fMqfa adopted in the present paper has mathematical desirable properties so that it 
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was used in many literatures on Tsallis statistics, and is rewritten by the standard expectation 
value as = J xh(x)dx where h(x) = j f(x)Qdx * s °^ en cane d the escort density function. 

If we adopt the constraints c[ c ^ or c[ 9 ^ due to the standard expectation value £a[-X] = 
f xf(x)dx, Theorem 12.21 and Theorem 12.51 can not be derived by the use of nonnegativity of 
the Tsallis relative entropy, as easily seen from the processes of their proofs. However for the 
standard expectation value, we have Corollary 12.41 and Corollary 12.61 That is, it was reconfirmed 
that the standard expectation value E\ corresponds to Shannon entropy and Kullback-Leibler 
information. 

As a one-parameter generalization of the standard expectation value E\, the following q- 
expectation value may be considered: 

/oo 
xf{xfdx. 
-oo 

For this ^-expectation value, we also have the following results. Define the constraints: 

C { q c) = {/ E D : xf(xfdx = iA, 

= {/ e C< c) : J°° (x - N ff{x)Ux = a 2 q \. 
Then we have the following results by the similar way to Theorem 12.21 and Theorem [2~ 
Theorem 4.1 (1) If <f> G C ( q c) , then 

H q (<j)(x)) < -c q ln q — 



7 io\ 



with equality if and only if 

where (3^ and Zq are same constant numbers in Theorem\2_ 
(2) Forq£R such that 0<q<3andq^lif(j)£ C q g) , then 



Z q 



with equality if and only if 



0( x ) = Tn\ ex P 



A 9 \x-^ q f 



z {9) ' q \ 

where (3 { q g) and Z { q 9) are same constant numbers in Theorem W. 

Moreover, we may define a q-Fisher information by the ^-expectation value -Evj[A] as J q (X) = 
Eq[s q (x) 2 ], where s q (x) is a same score function in Eq.(j4]). Then we have the following result by 
the similar way to Theorem! 
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Theorem 4.2 Given the random variable X with the probability density function p(x), the q- 
expectation value fi q = E q [X] and the q-variance o~ q = E q (X — fi q ) 2 , we have a q-Cramer-Rao 
inequality: 

J q (X)>\ for qe [0,1) U (1,3). (13) 
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In addition, the equality holds if p(x) = (j) q (x) and o~ q are given by Eq. HO\) or Eq. ill)) . 

Thus we can see that Theorem 14 . 1 1 and Theorem 14.21 are almost similar to the results obtained 
in Thorem l2.2[ Theorem 12 . 5 1 and Theorem 13. 3\ except for the normalization factor. We also find 
that Theorem 14.21 has a slightly modified form, if it is compared with Theorem 13.31 because a 
one-parameter generalized Cramer-Rao inequality (|13p holds for any q € R such that < q < 3 
and q 7^ 1, while the inequality ([9]) holds for 1 < q < 3. 

We close this section giving a comment on a possible application of our (/-Fisher informations. 
The central limit theorem, which is one of important theorems in probability theory, states the 
distribution function of the standardized sum of an independent sequence of random variables 
convergences to Gaussian distribution under a certain assumpution. The classical central limit 
theorem is usually proved by the characteristic function. However it is known that the Fisher 
information can be applied to prove the classical central limit theorem |18 |, I19 |, [20] . In addition, 
quite recently, the (/-central limit theorem for q > 1 was proved in |21j by introducing new 
notions such as (/-independence, (/-convergence, (/-Fourier transformation and (/-characteristic 
function. Therefore we may expect that a new proof of (/-central limit theorem may be given by 
applying (/-Fisher information in the future. 
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Appendix A 

On Theorem 12.51 we here show g-Gaussian distribution: 

<f>{x) = Z' 1 exp ? {-p q {x - ii q flo\} , (14) 
where Z q = exp g {— /3 g (x — /ig) 2 /cr 2 } dx with (3 q = 1/(3 — q) satisfies the constraints: 

1 f°° 

— / x<j){x) q dx = fj, q (15) 

c q J — oo 

and 

1 f°° 

- / {x-v q ) 2 (j ) {xydx = al (16) 

c <? J — oo 

where c q = 4>{x) q dx. 

( 2 \ i 

Proof: It is sufficient to prove the case of [i q = and a q = 1. Since the function x exp ? ( — ^- q ) 

is the odd function, we see that <j>(x) satisfies the first constraint. To show the second constraint 
is equivalent to show 



2 

-oo 

(1) < q < 1: Since 



°° x2 exp « (" WT) ) dx = /oo exp « (" (s^o ) ^ (17) 



eX P? -— — -r )=\ V (3-,) J »/ Vl-y X< VH 

V v 9// I otherwise 
The L.H.S. of Eq.([T7} is calculated by 

V 1_ 9 



■> - <i\ 3/2 B f : '> i 



1-4/ \2' 1 



Also the R.H.S. of Eq. flTTjl is calculated by 

x 2 

(3-g) 



1-9 



3-g 

1-q 



-i 

1/2 -l 



'l-y 2 )*-« 



In the process of the above calculations, the following formula: 
f 1 1 

/ (1 - x a ) r_1 = -Bf-^), (a > 0,p > 0,r > 0) 

Jo a Va / 

was used. By the properties of the beta function and gamma function, ^frf 1 ^ f|> jr^ 

coincides with ffzfl ^ (f ' ]~^g)' 
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(2) 1 < q < 3: The L.H.S. of Eq.flTH is calculated by 

(3^) 



g-i/ v.9- 1 22 



The R.H.S. of Eq.flTTJ) is calculated by 



v / „,2 \ 1 /g _ \ 1/2 x 



9 V (3-g)y/ " Vtf-l/ JO 



< >x p„ i — - 1 <<'-<• - 2 ( — t J / ( 1 + <r) 1 " 'hi 

1/2 



3 



.9-1/ V9-1 22 
In the process of the above calculations, the following formula: 

dx i / — 11 — j)\ 

-B[r-\ , , (a > 0,p < l,r > 0,ar > 1 - p) , 



o 



xP (1 + x a ) a \ a a 
which is derived from B(p, r) = B(r,p) and 

i-co T p-1 



f°° X p ~ 

B (p,r) = / M , ,p+r dx > (P>0,r>0) 
Jo (1 + xY 



to [1 + x 

was used. By the properties of the beta function and gamma function, f|E?l B ~ §> 

1/2 

coincides with f jpfl B (i^T ~~ ^' i 

Appendix B 

Proof of Theorem \4-S\ The inequality (|13p follows by the similar way to the proof of Theorem l3.3l 

~ 4/3 2 Z 2q ~ 2 

so that we prove the equality condition. We have J q {G) = — <L -^- — for the (/-Gaussian density 

function 4>q{x). In addition, we see that the equation 4f3^Zq 9 ^ 2 = 1 is equivalent to Eq. lfTOj) or 
Eq. ffTT]) . thanks to the formula B(p,r + 1) = ^ppB(p, r). ■ 
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